• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The invention relates to the technical field of computers, and more particularly, to a synchronous modulation method based on an embedded player. The method comprises the steps of: Step S1, acquiring a current timestamp adopted by a current synchronous audio signal and a current synchronous video signal; Step S2, acquiring a jump difference value of the current timestamp; Step S3, determining whether the jump difference value is less than a first preset time, if yes, synchronously playing, by the player, the audio signal and the video signal through a first timestamp, and exiting; and Step S4, determining whether the jump difference value is greater than a second preset time, if yes, synchronously playing, by the player, the audio signal and the video signal through a second timestamp, and exiting. The method has the beneficial effects that the synchronization mode is dynamically switched according to the time difference of the two timestamps, so that the problem of jamming caused by time stamp hopping is effectively solved, the fault tolerance of the player is further improved, and the user experience is improved.
    公开号:EP3683796A1
    申请号:EP20151816.4
    申请日:2020-01-14
    公开日:2020-07-22
    发明作者:Ting YAO；Zhi Zhou；Lifeng CAO；Zhiheng Cao；Yunmin CHEN
    申请人:Amlogic Shanghai Co Ltd；
    IPC主号:G11B27-00
    专利说明:
    [0001] The invention relates to the technical field of computers, and more particularly, to a synchronous modulation method based on an embedded player. 2. Description of the Related Art
    [0002] For an embedded player, an audio and video synchronization is achieved by using a timestamp, and normal audio timestamp information and normal video timestamp information are recorded in a video packaging portion. The timestamp of the embedded player increases linearly. When the timestamp of the embedded player is normal time, in most cases, a third-party reference clock in a linear increase mode acts as a reference clock to compare to the audio timestamp and video timestamp, so that the audio and video synchronization is completed.
    [0003] At present, the problem with the method is that there are all kinds of video packaging formats, audio and video coding at an acquisition end is compositely packaged. In some cases, it may cause the composite audio timestamp and video timestamp to hop. In particular, the timestamp of the audio and video hops backward or forward, or only one path of the timestamp hops; when a third-party reference clock increasing linearly acts as a synchronization reference clock, timestamp hopping may lead to the following events, that is, the video may be jammed or fast forwarded, or audio and video are not synchronized.
    [0004] An improved solution for solving the above-mentioned technical problems is not provided. SUMMARY OF THE INVENTION
    [0005] Given that the foregoing problems exist in the prior art, the present invention provides a synchronous modulation method based on an embedded player.
    [0006] The technical solution is as follows: Step S1, acquiring a current timestamp adopted by a current synchronous audio signal and a current synchronous video signal; Step S2, acquiring a jump difference value of the current timestamp; Step S3, determining whether the jump difference value is less than a first preset time, if yes, synchronously playing, by the player, the audio signal and the video signal through a first timestamp, and exiting; and Step S4, determining whether the jump difference value is greater than a second preset time, if yes, synchronously playing, by the player, the audio signal and the video signal through a second timestamp, and exiting.
    [0007] Preferably, wherein the first timestamp is an audio timestamp corresponding to the audio signal; the second timestamp is a video timestamp corresponding to the video signal.
    [0008] Preferably, wherein in Step S3, a type of the current timestamp is saved before exiting; andin Step S4, a type of the current timestamp is saved before exiting.
    [0009] Preferably, wherein Step S2 further comprises: detecting whether the current timestamp is the first timestamp; if yes, comparing the first timestamp to the second timestamp to acquire the jump difference value; if no, comparing the current timestamp to a timestamp corresponding to the saved type of the current timestamp, to acquire the jump difference value.
    [0010] Preferably, the method further comprises:Step S5, when it is determined that the jump difference value is less than the second preset time but is greater than the first preset time, the player uses the second timestamp as the current timestamp to synchronously play the audio signal and the video signal, and waits for a retest.
    [0011] Preferably, the method further comprises: Step S6, determining whether the current timestamp is changed to the first timestamp; if no, then executing Step S7; if yes, then exiting; Step S7, detecting whether a wait time reaches a third preset time; if yes, then returning to Step S1; if no, then returning to Step S6.
    [0012] Preferably, wherein in Step S6, the synchronous modulation method performed by another process changes the current timestamp.
    [0013] Preferably, wherein the first preset time is in a range of 2s to 7s.
    [0014] Preferably, wherein the second preset time is in a range of 40s to 80s.
    [0015] Preferably, wherein the third preset time is in a range of 10s to 30s.
    [0016] By adopting the above-mentioned technical solution, the present invention has the beneficial effects that a synchronous modulation method based on an embedded player is provided, instead of using a third-party reference clock increasing linearly as a synchronization reference clock in the prior art, the synchronous modulation method according to the present invention uses two different timestamps. When the player plays a video, the synchronization mode is dynamically switched according to a time difference of the two timestamps, so that the problem of video playing abnormalities caused by the timestamp hopping is effectively solved, the player is allowed to continue playing the video, the fault tolerance of the player is further improved, the user experience is improved, and the player is adapted to different types of streaming media servers. BRIEF DESCRIPTION OF THE DRAWINGS
    [0017] The accompanying drawings, together with the specification, illustrate exemplary embodiments of the present disclosure, and, together with the description, serve to explain the principles of the present invention.Figure 1 is a flowchart illustrating steps of a synchronous modulation method based on an embedded player according to an embodiment of the present invention; Figure 2 is a flowchart illustrating a step 2 of a synchronous modulation method based on an embedded player according to an embodiment of the present invention; Figure 3 is a flowchart illustrating steps of a synchronous modulation method based on an embedded player according to an embodiment of the present invention; and Figure 4 is a flowchart illustrating steps of a synchronous modulation method based on an embedded player according to a further embodiment of the present invention. DETAILED DESCRIPTION
    [0018] The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like reference numerals refer to like elements throughout.
    [0019] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," or "includes" and/or "including" or "has" and/or "having" when used herein, specify the presence of stated features, regions, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, regions, integers, steps, operations, elements, components, and/or groups thereof.
    [0020] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
    [0021] As used herein, "around", "about" or "approximately" shall generally mean within 20 percent, preferably within 10 percent, and more preferably within 5 percent of a given value or range. Numerical quantities given herein are approximate, meaning that the term "around", "about" or "approximately" can be inferred if not expressly stated.
    [0022] As used herein, the term "plurality" means a number greater than one.
    [0023] Hereinafter, certain exemplary embodiments according to the present disclosure will be described with reference to the accompanying drawings.
    [0024] At present, the issue is that there are all kinds of video packaging formats, audio coding and video coding at an acquisition end are compositely packaged. In some cases, it may cause the composite audio and video timestamp to hop. In particular, the audio and video timestamp hops backward or forward, or only one path of the timestamp hops; when a third-party reference clock increasing linearly acts as a synchronization reference, timestamp hopping may lead to the following events, that is, the video may be jammed or fast forwarded, or audio and video are not synchronized.
    [0025] Given that the foregoing problems exist in the prior art, the present invention provides a synchronous modulation method based on an embedded player, as shown in Figure 1, the method comprising: Step S1, acquiring a current timestamp adopted by a current synchronous audio signal and a current synchronous video signal; Step S2, acquiring a jump difference value of the current timestamp; Step S3, determining whether the jump difference value is less than a first preset time, if yes, synchronously playing, by the player, the audio signal and the video signal through a first timestamp, and exiting; and Step S4, determining whether the jump difference value is greater than a second preset time, if yes, synchronously playing, by the player, the audio signal and the video signal through a second timestamp, and exiting.
    [0026] The above-mentioned synchronous modulation method based on an embedded player, as shown in Figure 1, is applied to a synchronization modulation process after the timestamp of the audio and video hops. Instead of using a third-party reference clock increasing linearly as a synchronization reference in the prior art, the synchronous modulation method according to the present invention uses two different timestamps, that is, a first timestamp and a second timestamp. When the player plays a video, the synchronization mode is dynamically switched according to a time difference of the two timestamps, so that the problem of video playing abnormalities caused by the timestamp hopping is effectively solved.
    [0027] Specifically, first of all, acquiring a current timestamp adopted by a current synchronous audio signal and a current synchronous video signal. The current timestamp is any one of the first timestamp and the second timestamp, depending on the situation to which the technical solution is applied. When the player is initially playing, one of the first timestamp and the second timestamp may be selected as a default timestamp. For example, the first timestamp may be selected as a timestamp for synchronization of the audio signal and the video signal by default. Next, a jump difference value of the current timestamp is acquired. Then it is determined whether the jump difference value is less than a first preset time. When it is determined that the jump difference value is less than the first preset time, the player synchronously plays the audio signal and the video signal through the first timestamp.
    [0028] In the above-mentioned technical solution, when the jump difference value of the current timestamp is less than the first preset time, it indicates that the current timestamp does not jump dramatically. Therefore, it is believed that the synchronization of the current audio signal and the current video signal is acceptable. The audio signal and the video signal are synchronized by using the first timestamp. When the first timestamp is selected as a timestamp for synchronization of the audio signal and the video signal by default, it means that when the jump difference value of the current timestamp is less than the first preset time, the audio signal and the video signal are synchronized by using the default timestamp.
    [0029] Furthermore, it is determined whether the jump difference value is greater than a second preset time. When it is determined that the jump difference value is greater than the second preset time, the player synchronously plays the audio signal and the video signal through a second timestamp.
    [0030] When the jump difference value is greater than the second preset time, it indicates that the current timestamp hops dramatically. Therefore, it is believed that the synchronization of the current audio signal and the current video signal is not acceptable. The audio signal and the video signal are synchronized by using the second timestamp. When the first timestamp is selected as a timestamp for synchronization of the audio signal and the video signal by default, it means that when the jump difference value of the current timestamp is greater than the second preset time, the audio signal and the video signal are synchronized by using a timestamp different from the default timestamp.
    [0031] The first preset time is in a range of 2s to 7s. Preferably, the first preset time may be 2s, 3s, 4s, 5s, 6s, or 7s.
    [0032] The second preset time is in a range of 40s to 80s. Preferably, the second preset time may be 40s, 45s, 50s, 60s, 65s, 70s, 75s, or 80s.
    [0033] Furthermore, by using the above-mentioned synchronous modulation method, after the timestamp of the player jumps, the video continues playing as expected, and the audio and video may play synchronously; then video jamming and fast forward and slow forward may be further avoided; in particular for live streaming, the normal playback of the live streaming is not affected; the fault tolerance of the player is further improved, the user experience is improved, and the player is adapted to different types of streaming media servers.
    [0034] As a preferred embodiment, the first timestamp is an audio timestamp corresponding to the audio signal; the second timestamp is a video timestamp corresponding to the video signal.
    [0035] Based on the above-mentioned technical solution, in Step S3, a type of the current timestamp is saved before exiting; andin Step S4, a type of the current timestamp is saved before exiting.
    [0036] For the above-mentioned technical solution, after the timestamp of the player for the synchronization of the audio signal and the video signal is selected, the previous timestamp configured to synchronize the audio signal and the video signal is saved, that is, the current timestamp obtained in Step S1 is saved before exiting.
    [0037] Based on the above-mentioned technical solution, as shown in Figure 2, Step S2 further comprises: detecting whether the current timestamp is the first timestamp; if yes, comparing the first timestamp to the second timestamp to acquire the jump difference value; if no, comparing the current timestamp to a timestamp corresponding to the saved type of the current timestamp, to acquire the jump difference value.
    [0038] In the above-mentioned technical solution, when the current timestamp is the first timestamp, compare the first timestamp to the second timestamp to acquire the jump difference value. From Step S3, it can be known that when the current timestamp is the first timestamp, it means that the timestamp jump difference value is within an acceptable range, so the first timestamp needs to be compared to the second timestamp only.
    [0039] If the current timestamp is not the first timestamp, it means that the current timestamp is the second timestamp. From Step S4, it can be known that when the current timestamp is the second timestamp, it means that dramatic timestamp hop occurred, so the second timestamp needs to be compared to the current timestamp obtained in the previous synchronous modulation.
    [0040] Based on the above-mentioned technical solution, as shown in Figure 3, the synchronous modulation method further comprises:Step S5, when it is determined that the jump difference value is less than the second preset time but is greater than the first preset time, the player uses the second timestamp as the current timestamp to synchronously play the audio signal and the video signal, and waits for a retest.
    [0041] In the above-mentioned technical solution, when the jump difference value of the current timestamp is less than the second preset time but is greater than the first preset time, it means that the current timestamp has jumped, but is still in a recoverable state. Accordingly, corresponding time is set aside for its recovery. When the current timestamp changes, the previous type of current timestamp in a synchronization mode is not required to be saved; when the jump 'difference value is less than the second preset time but is greater than the first preset time, a video timestamp acts as a synchronization reference, and audio and video synchronization is not performed.
    [0042] Furthermore, as shown in Figure 4, the method further comprises: Step S6, determining whether the current timestamp is changed to the first timestamp; if no, then executing Step S7; if yes, then exiting; Step S7, detecting whether a wait time reaches a third preset time; if yes, then returning to Step S1; if no, then returning to Step S6.
    [0043] In the above-mentioned technical solution, when Step S5 is in a wait state, another process may restart the synchronous modulation process. In Step S6, determining whether a synchronous modulation performed by another process changes the current timestamp. That is, determining whether the current timestamp is changed from the second timestamp to the first timestamp, if yes, it can be known from Step S3 that when the current timestamp is changed to the first timestamp, the timestamp jump difference value of the current timestamp is within an acceptable range, that is, the timestamp is recovered successfully, so that it is allowed to exit the synchronous modulation process; if no, it means that the timestamp is not recovered successfully, keep waiting and monitoring whether the current timestamp changes. When the wait time reaches the third preset time, it means that the timestamp jump fails to recover, then executing Step S1, and starting to perform a new round of synchronous modulation.
    [0044] Wherein, the third preset time is in a range of 10s to 30s. As a preferred embodiment, the third preset time may be 10s, 12s, 14s, 16s, 18s, 20s, 22s, 24s, 26s, 28s, or 30s.
    [0045] In the above-mentioned technical solution, the first timestamp and the second timestamp are set to correspond to two key elements when the video is playing. The appearance of the two timestamps may represent different historical situation through the process control, so that the system may execute a corresponding judgment process according to the current timestamp. After the timestamp of the player jumps, the video continues playing as expected, and the audio and video may play synchronously; then video jamming, fast forward and slow forward may be further avoided; in particular for live streaming, the normal playback of the live streaming is not affected; the fault tolerance of the player is further improved, the user experience is improved, and the player is adapted to different types of streaming media servers.
    [0046] The above descriptions are only the preferred embodiments of the invention, not thus limiting the embodiments and scope of the invention. Those skilled in the art should be able to realize that the schemes obtained from the content of specification and drawings of the invention are within the scope of the invention.
    权利要求:
    Claims (10)
    [0001] A synchronous modulation method based on an embedded player, comprising:
    Step S1, acquiring a current timestamp adopted by a current synchronous audio signal and a current synchronous video signal;
    Step S2, acquiring a jump difference value of the current timestamp;
    Step S3, determining whether the jump difference value is less than a first preset time, if yes, synchronously playing, by the player, the audio signal and the video signal through a first timestamp, and exiting; and
    Step S4, determining whether the jump difference value is greater than a second preset time, if yes, synchronously playing, by the player, the audio signal and the video signal through a second timestamp, and exiting.
    [0002] The synchronous modulation method based on an embedded player according to claim 1, wherein the first timestamp is an audio timestamp corresponding to the audio signal; the second timestamp is a video timestamp corresponding to the video signal.
    [0003] The synchronous modulation method based on an embedded player according to claim 2, wherein in Step S3, a type of the current timestamp is saved before exiting; andin Step S4, a type of the current timestamp is saved before exiting.
    [0004] The synchronous modulation method based on an embedded player according to claim 3, wherein Step S2 further comprises:
    detecting whether the current timestamp is the first timestamp;
    if yes, comparing the first timestamp to the second timestamp to acquire the jump difference value;
    if no, comparing the current timestamp to a timestamp corresponding to the saved type of the current timestamp, to acquire the jump difference value.
    [0005] The synchronous modulation method based on an embedded player according to claim 4, further comprising:Step S5, when it is determined that the jump difference value is less than the second preset time but is greater than the first preset time, the player uses the second timestamp as the current timestamp to synchronously play the audio signal and the video signal, and waits for a retest.
    [0006] The synchronous modulation method based on an embedded player according to claim 5, further comprising:
    Step S6, determining whether the current timestamp is changed to the first timestamp;
    if no, then executing Step S7;
    if yes, then exiting;
    Step S7, detecting whether a wait time reaches a third preset time;
    if yes, then returning to Step S1;
    if no, then returning to Step S6.
    [0007] The synchronous modulation method based on an embedded player according to claim 6, wherein in Step S6, the synchronous modulation method performed by another process changes the current timestamp.
    [0008] The synchronous modulation method based on an embedded player according to claim 1, wherein the first preset time is in a range of 2s to 7s.
    [0009] The synchronous modulation method based on an embedded player according to claim 1, wherein the second preset time is in a range of 40s to 80s.
    [0010] The synchronous modulation method based on an embedded player according to claim 6, wherein the third preset time is in a range of 10s to 30s.
    类似技术:
    公开号 | 公开日 | 专利标题
    CN103890848B|2016-03-09|Video information reproduction method and device for reproducing video information
    ES2268815T3|2007-03-16|DATA REPRODUCTION DEVICE.
    KR100348672B1|2002-11-16|Data reproducing apparatus
    KR100811962B1|2008-03-10|Recording apparatus and method, reproducing apparatus and method, and recording media thereof
    JP3943516B2|2007-07-11|Image playback device
    JP4391409B2|2009-12-24|High-efficiency-encoded time-series information transmission method and apparatus for real-time streaming transmission and reception
    CN1076928C|2001-12-26|Apparatus for reproducing and decoding multiplexed data from a record medium with means for controlling data decoding as a function of synchronization errors
    JP4349277B2|2009-10-21|Movie playback device
    US8982943B2|2015-03-17|Data processing device and data processing method
    US8014484B2|2011-09-06|Stream data recording device, stream data editing device, stream data reproducing device, stream data recording method, and stream data reproducing method
    EP1950963B1|2012-12-12|Video reproducing device, method and program
    KR100296528B1|2001-10-24|Multiplexed Data Separation Apparatus and Method
    CN102037718B|2014-12-31|Method and apparatus for masking signal loss
    US20090103892A1|2009-04-23|Stream Data Recording Device, Stream Data Recording/Reproducing Device, Stream Data Reproduction Device, Stream Data Editing Device, Stream Recording Method, and Stream Reproducing Method
    KR20010043344A|2001-05-25|Method for storing compressed digital audio and video
    US7152197B2|2006-12-19|Error correction of stream data
    JP5239858B2|2013-07-17|Playback apparatus and method, and program
    US6151443A|2000-11-21|Digital video and data recorder
    US7212726B2|2007-05-01|System and method of processing MPEG streams for file index insertion
    US7748020B2|2010-06-29|Receiving apparatus and method for processing interruptions in streaming broadcasts
    JP5700589B2|2015-04-15|Synchronized stream packing
    US6512884B1|2003-01-28|Method and apparatus for synchronized play back of audio-video signals
    WO2001075888A1|2001-10-11|Method and apparatus for editing digital video recordings, and recordings made by such methods
    WO2009136236A1|2009-11-12|Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams
    KR101513711B1|2015-04-21|Method and System for Repairing Damaged Hard Disk File Systems
    同族专利:
    公开号 | 公开日
    CN109729404A|2019-05-07|
    US20200228683A1|2020-07-16|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    法律状态:
    2020-06-19| STAA| Information on the status of an ep patent application or granted ep patent|Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
    2020-06-19| PUAI| Public reference made under article 153(3) epc to a published international application that has entered the european phase|Free format text: ORIGINAL CODE: 0009012 |
    2020-07-22| AX| Request for extension of the european patent|Extension state: BA ME |
    2020-07-22| AK| Designated contracting states|Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
    2020-12-25| STAA| Information on the status of an ep patent application or granted ep patent|Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
    2021-01-27| RBV| Designated contracting states (corrected)|Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
    2021-01-27| 17P| Request for examination filed|Effective date: 20201217 |
    2021-04-03| STAA| Information on the status of an ep patent application or granted ep patent|Free format text: STATUS: EXAMINATION IS IN PROGRESS |
    2021-05-05| 17Q| First examination report despatched|Effective date: 20210401 |
    2021-06-03| STAA| Information on the status of an ep patent application or granted ep patent|Free format text: STATUS: GRANT OF PATENT IS INTENDED |
    2021-06-03| GRAP| Despatch of communication of intention to grant a patent|Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
    2021-06-30| INTG| Intention to grant announced|Effective date: 20210604 |
    2021-09-24| GRAS| Grant fee paid|Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
    2021-10-01| STAA| Information on the status of an ep patent application or granted ep patent|Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
    2021-10-01| GRAA| (expected) grant|Free format text: ORIGINAL CODE: 0009210 |
    2021-11-03| AK| Designated contracting states|Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
    2021-11-03| REG| Reference to a national code|Ref country code: GB Ref legal event code: FG4D |
    2021-11-15| REG| Reference to a national code|Ref country code: AT Ref legal event code: REF Ref document number: 1444696 Country of ref document: AT Kind code of ref document: T Effective date: 20211115 Ref country code: CH Ref legal event code: EP |
    2021-11-24| REG| Reference to a national code|Ref country code: IE Ref legal event code: FG4D |
    2021-11-25| REG| Reference to a national code|Ref country code: DE Ref legal event code: R096 Ref document number: 602020000864 Country of ref document: DE |
    2022-01-31| PGFP| Annual fee paid to national office [announced via postgrant information from national office to epo]|Ref country code: FR Payment date: 20211216 Year of fee payment: 3 |
    2022-02-25| REG| Reference to a national code|Ref country code: LT Ref legal event code: MG9D |
    优先权:
    申请号 | 申请日 | 专利标题
    [返回顶部]